Deep Networks for Collaboration Analytics: Promoting Automatic Analysis of Face-to-Face Interaction in the Context of Inquiry-Based Learning

Autor/inn/en	Lämsä, Joni; Uribe, Pablo; Jiménez, Abelino; Caballero, Daniela; Hämäläinen, Raija; Araya, Roberto
Titel	Deep Networks for Collaboration Analytics: Promoting Automatic Analysis of Face-to-Face Interaction in the Context of Inquiry-Based Learning
Quelle	In: Journal of Learning Analytics, 8 (2021) 1, S.113-125 (14 Seiten)Infoseite zur Zeitschrift PDF als Volltext kostenfreie Datei Verfügbarkeit
Zusatzinformation	ORCID (Lämsä, Joni) ORCID (Uribe, Pablo) ORCID (Jiménez, Abelino) ORCID (Caballero, Daniela) ORCID (Hämäläinen, Raija) ORCID (Araya, Roberto)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1929-7750
Schlagwörter	Cooperative Learning; Computer Assisted Instruction; Synchronous Communication; Learning Analytics; Accuracy; Automation; Coding; Transcripts (Written Records); Natural Language Processing; Interaction; Active Learning; Inquiry; Undergraduate Students; Physics; Introductory Courses; Attention; Foreign Countries; Finland + Suchen Sie Ihr Suchwort? Kooperatives Lernen; Computer based training; Computerunterstützter Unterricht; Codierung; Programmierung; Natürliche Sprache; Interaktion; Aktives Lernen; Physik; Einführungskurs; Aufmerksamkeit; Ausland; Finnland
Abstract	Scholars have applied automatic content analysis to study computer-mediated communication in computer-supported collaborative learning (CSCL). Since CSCL also takes place in face-to-face interactions, we studied the automatic coding accuracy of manually transcribed face-to-face communication. We conducted our study in an authentic higher-education physics context where computer-supported collaborative inquiry-based learning (CSCIL) is a popular pedagogical approach. Since learners' needs for support in CSCIL vary in the different inquiry phases (orientation, conceptualization, investigation, conclusion, and discussion), we studied, first, how the coding accuracy of five computational models (based on word embeddings and deep neural networks with attention layers) differed in the various inquiry-based learning (IBL) phases when compared to human coding. Second, we investigated how the different features of the best performing computational model improved the coding accuracy. The study indicated that the accuracy of the best performing computational model (differentiated attention with pre-trained static embeddings) was slightly better than that of the human coder (58.9% vs. 54.3%). We also found that considering the previous and following utterances, as well as the relative position of the utterance, improved the model's accuracy. Our method illustrates how computational models can be trained for specific purposes (e.g., to code IBL phases) with small data sets by using pre-trained models. (As Provided).
Anmerkungen	Society for Learning Analytics Research. 121 Pointe Marsan, Beaumont, AB T4X 0A2, Canada. Tel: +61-429-920-838; e-mail: info@solaresearch.org; Web site: https://learning-analytics.info/index.php/JLA/index
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01